Generating Clinical-Grade Gene-Disease Validity Classifications Through the ClinGen Data Platforms.

Clinical genetic laboratories must have access to clinically validated biomedical data for precision medicine. A lack of accessibility, normalized structure, and consistency in evaluation complicates interpretation of disease causality, resulting in confusion in assessing the clinical validity of genes and genetic variants for diagnosis. A key goal of the Clinical Genome Resource (ClinGen) is to fill the knowledge gap concerning the strength of evidence supporting the role of a gene in a monogenic disease, which is achieved through a process known as Gene-Disease Validity curation. Here we review the work of ClinGen in developing a curation infrastructure that supports the standardization, harmonization, and dissemination of Gene-Disease Validity data through the creation of frameworks and the utilization of common data standards. This infrastructure is based on several applications, including the ClinGen GeneTracker, Gene Curation Interface, Data Exchange, GeneGraph, and website.

Accessing clinical-grade genomic classification data through the ClinGen Data Platform.

The Clinical Genome Resource (ClinGen) serves as an authoritative resource on the clinical relevance of genes and variants. In order to support our curation activities and to disseminate our findings to the community, we have developed a Data Platform of informatics resources backed by standardized data models. In this workshop we demonstrate our publicly available resources including curation interfaces, (Variant Curation Interface, CIViC), supporting infrastructure (Allele Registry, Genegraph), and data models (SEPIO, GA4GH VRS, VA).

ClinGen Variant Curation Interface: a variant classification platform for the application of evidence criteria from ACMG/AMP guidelines.

BACKGROUND: Identification of clinically significant genetic alterations involved in human disease has been dramatically accelerated by developments in next-generation sequencing technologies. However, the infrastructure and accessible comprehensive curation tools necessary for analyzing an individual patient genome and interpreting genetic variants to inform healthcare management have been lacking. RESULTS: Here we present the ClinGen Variant Curation Interface (VCI), a global open-source variant classification platform for supporting the application of evidence criteria and classification of variants based on the ACMG/AMP variant classification guidelines. The VCI is among a suite of tools developed by the NIH-funded Clinical Genome Resource (ClinGen) Consortium and supports an FDA-recognized human variant curation process. Essential to this is the ability to enable collaboration and peer review across ClinGen Expert Panels supporting users in comprehensively identifying, annotating, and sharing relevant evidence while making variant pathogenicity assertions. To facilitate evidence-based improvements in human variant classification, the VCI is publicly available to the genomics community. Navigation workflows support users providing guidance to comprehensively apply the ACMG/AMP evidence criteria and document provenance for asserting variant classifications. CONCLUSIONS: The VCI offers a central platform for clinical variant classification that fills a gap in the learning healthcare system, facilitates widespread adoption of standards for clinical curation, and is available at https://curation.clinicalgenome.org.

An Investigation of the Knowledge Overlap between Pharmacogenomics and Disease Genetics.

Precision medicine faces many challenges, including the gap of knowledge between disease genetics and pharmacogenomics (PGx). Disease genetics interprets the pathogenicity of genetic variants for diagnostic purposes, while PGx investigates the genetic influences on drug responses. Ideally, the quality of health care would be improved from the point of disease diagnosis to drug prescribing if PGx is integrated with disease genetics in clinical care. However, PGx genes or variants are usually not reported as a secondary finding even if they are included in a clinical genetic test for diagnostic purposes. This happens even though the detection of PGx variants can provide valuable drug prescribing recommendations. One underlying reason is the lack of systematic classification of the knowledge overlap between PGx and disease genetics. Here, we address this issue by analyzing gene and genetic variant annotations from multiple expert-curated knowledge databases, including PharmGKB, CPIC, ClinGen and ClinVar. We further classified genes based on the strength of evidence supporting a gene's pathogenic role or PGx effect as well as the level of clinical actionability of a gene. Twenty-six genes were found to have pathogenic variation associated with germline diseases as well as strong evidence for a PGx association. These genes were classified into four sub-categories based on the distinct connection between the gene's pathogenic role and PGx effect. Moreover, we have also found thirteen RYR1 genetic variants that were annotated as pathogenic and at the same time whose PGx effect was supported by a preponderance of evidence and given drug prescribing recommendations. Overall, we identified a nontrivial number of gene and genetic variant overlaps between disease genetics and PGx, which laid out a foundation for combining PGx and disease genetics to improve clinical care from disease diagnoses to drug prescribing and adherence.

Evaluating the impact of in silico predictors on clinical variant classification.

PURPOSE: According to the American College of Medical Genetics and Genomics/Association of Medical Pathology (ACMG/AMP) guidelines, in silico evidence is applied at the supporting strength level for pathogenic (PP3) and benign (BP4) evidence. Although PP3 is commonly used, less is known about the effect of these criteria on variant classification outcomes. METHODS: A total of 727 missense variants curated by Clinical Genome Resource expert groups were analyzed to determine how often PP3 and BP4 were applied and their impact on variant classification. The ACMG/AMP categorical system of variant classification was compared with a quantitative point-based system. The pathogenicity likelihood ratios of REVEL, VEST, FATHMM, and MPC were calibrated using a gold standard set of 237 pathogenic and benign variants (classified independent of the PP3/BP4 criteria). RESULTS: The PP3 and BP4 criteria were applied by Variant Curation Expert Panels to 55% of missense variants. Application of those criteria changed the classification of 15% of missense variants for which either criterion was applied. The point-based system resolved borderline classifications. REVEL and VEST performed best at a strength level consistent with moderate evidence. CONCLUSION: We show that in silico criteria are commonly applied and often affect the final variant classifications. When appropriate thresholds for in silico predictors are established, our results show that PP3 and BP4 can be used at a moderate strength.

Clinical Genetics Lacks Standard Definitions and Protocols for the Collection and Use of Diversity Measures.

Genetics researchers and clinical professionals rely on diversity measures such as race, ethnicity, and ancestry (REA) to stratify study participants and patients for a variety of applications in research and precision medicine. However, there are no comprehensive, widely accepted standards or guidelines for collecting and using such data in clinical genetics practice. Two NIH-funded research consortia, the Clinical Genome Resource (ClinGen) and Clinical Sequencing Evidence-generating Research (CSER), have partnered to address this issue and report how REA are currently collected, conceptualized, and used. Surveying clinical genetics professionals and researchers (n = 448), we found heterogeneity in the way REA are perceived, defined, and measured, with variation in the perceived importance of REA in both clinical and research settings. The majority of respondents (>55%) felt that REA are at least somewhat important for clinical variant interpretation, ordering genetic tests, and communicating results to patients. However, there was no consensus on the relevance of REA, including how each of these measures should be used in different scenarios and what information they can convey in the context of human genetics. A lack of common definitions and applications of REA across the precision medicine pipeline may contribute to inconsistencies in data collection, missing or inaccurate classifications, and misleading or inconclusive results. Thus, our findings support the need for standardization and harmonization of REA data collection and use in clinical genetics and precision health research.

LitGen: Genetic Literature Recommendation Guided by Human Explanations.

As genetic sequencing costs decrease, the lack of clinical interpretation of variants has become the bottleneck in using genetics data. A major rate limiting step in clinical interpretation is the manual curation of evidence in the genetic literature by highly trained biocurators. What makes curation particularly time-consuming is that the curator needs to identify papers that study variant pathogenicity using different types of approaches and evidences-e.g. biochemical assays or case control analysis. In collaboration with the Clinical Genomic Resource (ClinGen)-the flagship NIH program for clinical curation-we propose the first machine learning system, LitGen, that can retrieve papers for a particular variant and filter them by specific evidence types used by curators to assess for pathogenicity. LitGen uses semi-supervised deep learning to predict the type of evi+dence provided by each paper. It is trained on papers annotated by ClinGen curators and systematically evaluated on new test data collected by ClinGen. LitGen further leverages rich human explanations and unlabeled data to gain 7.9%-12.6% relative performance improvement over models learned only on the annotated papers. It is a useful framework to improve clinical variant curation.

Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework.

BACKGROUND: The American College of Medical Genetics and Genomics (ACMG)/Association for Molecular Pathology (AMP) clinical variant interpretation guidelines established criteria for different types of evidence. This includes the strong evidence codes PS3 and BS3 for "well-established" functional assays demonstrating a variant has abnormal or normal gene/protein function, respectively. However, they did not provide detailed guidance on how functional evidence should be evaluated, and differences in the application of the PS3/BS3 codes are a contributor to variant interpretation discordance between laboratories. This recommendation seeks to provide a more structured approach to the assessment of functional assays for variant interpretation and guidance on the use of various levels of strength based on assay validation. METHODS: The Clinical Genome Resource (ClinGen) Sequence Variant Interpretation (SVI) Working Group used curated functional evidence from ClinGen Variant Curation Expert Panel-developed rule specifications and expert opinions to refine the PS3/BS3 criteria over multiple in-person and virtual meetings. We estimated the odds of pathogenicity for assays using various numbers of variant controls to determine the minimum controls required to reach moderate level evidence. Feedback from the ClinGen Steering Committee and outside experts were incorporated into the recommendations at multiple stages of development. RESULTS: The SVI Working Group developed recommendations for evaluators regarding the assessment of the clinical validity of functional data and a four-step provisional framework to determine the appropriate strength of evidence that can be applied in clinical variant interpretation. These steps are as follows: (1) define the disease mechanism, (2) evaluate the applicability of general classes of assays used in the field, (3) evaluate the validity of specific instances of assays, and (4) apply evidence to individual variant interpretation. We found that a minimum of 11 total pathogenic and benign variant controls are required to reach moderate-level evidence in the absence of rigorous statistical analysis. CONCLUSIONS: The recommendations and approach to functional evidence evaluation described here should help clarify the clinical variant interpretation process for functional assays. Further, we hope that these recommendations will help develop productive partnerships with basic scientists who have developed functional assays that are useful for interrogating the function of a variety of genes.

ClinGen Allele Registry links information about genetic variants.

Effective exchange of information about genetic variants is currently hampered by the lack of readily available globally unique variant identifiers that would enable aggregation of information from different sources. The ClinGen Allele Registry addresses this problem by providing (1) globally unique "canonical" variant identifiers (CAids) on demand, either individually or in large batches; (2) access to variant-identifying information in a searchable Registry; (3) links to allele-related records in many commonly used databases; and (4) services for adding links to information about registered variants in external sources. A core element of the Registry is a canonicalization service, implemented using in-memory sequence alignment-based index, which groups variant identifiers denoting the same nucleotide variant and assigns unique and dereferenceable CAids. More than 650 million distinct variants are currently registered, including those from gnomAD, ExAC, dbSNP, and ClinVar, including a small number of variants registered by Registry users. The Registry is accessible both via a web interface and programmatically via well-documented Hypertext Transfer Protocol (HTTP) Representational State Transfer Application Programming Interface (REST-APIs). For programmatic interoperability, the Registry content is accessible in the JavaScript Object Notation for Linked Data (JSON-LD) format. We present several use cases and demonstrate how the linked information may provide raw material for reasoning about variant's pathogenicity.

Unique aspects of sequence variant interpretation for inborn errors of metabolism (IEM): The ClinGen IEM Working Group and the Phenylalanine Hydroxylase Gene.

The ClinGen Inborn Errors of Metabolism Working Group was tasked with creating a comprehensive, standardized knowledge base of genes and variants for metabolic diseases. Phenylalanine hydroxylase (PAH) deficiency was chosen to pilot development of the Working Group's standards and guidelines. A PAH variant curation expert panel (VCEP) was created to facilitate this process. Following ACMG-AMP variant interpretation guidelines, we present the development of these standards in the context of PAH variant curation and interpretation. Existing ACMG-AMP rules were adjusted based on disease (6) or strength (5) or both (2). Disease adjustments include allele frequency thresholds, functional assay thresholds, and phenotype-specific guidelines. Our validation of PAH-specific variant interpretation guidelines is presented using 85 variants. The PAH VCEP interpretations were concordant with existing interpretations in ClinVar for 69 variants (81%). Development of biocurator tools and standards are also described. Using the PAH-specific ACMG-AMP guidelines, 714 PAH variants have been curated and will be submitted to ClinVar. We also discuss strategies and challenges in applying ACMG-AMP guidelines to autosomal recessive metabolic disease, and the curation of variants in these genes.

Evaluating the Clinical Validity of Gene-Disease Associations: An Evidence-Based Framework Developed by the Clinical Genome Resource.

With advances in genomic sequencing technology, the number of reported gene-disease relationships has rapidly expanded. However, the evidence supporting these claims varies widely, confounding accurate evaluation of genomic variation in a clinical setting. Despite the critical need to differentiate clinically valid relationships from less well-substantiated relationships, standard guidelines for such evaluation do not currently exist. The NIH-funded Clinical Genome Resource (ClinGen) has developed a framework to define and evaluate the clinical validity of gene-disease pairs across a variety of Mendelian disorders. In this manuscript we describe a proposed framework to evaluate relevant genetic and experimental evidence supporting or contradicting a gene-disease relationship and the subsequent validation of this framework using a set of representative gene-disease pairs. The framework provides a semiquantitative measurement for the strength of evidence of a gene-disease relationship that correlates to a qualitative classification: "Definitive," "Strong," "Moderate," "Limited," "No Reported Evidence," or "Conflicting Evidence." Within the ClinGen structure, classifications derived with this framework are reviewed and confirmed or adjusted based on clinical expertise of appropriate disease experts. Detailed guidance for utilizing this framework and access to the curation interface is available on our website. This evidence-based, systematic method to assess the strength of gene-disease relationships will facilitate more knowledgeable utilization of genomic variants in clinical and research settings.